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Estimates  and  3o'jrds  on  Computational  Effort 
in  the  Accelerated  Bound-and-Scan  Algorithm 

by 

Bruce  H.  Faaland 


A.  Introduction 

The  pure  Integer  linear  programming  (IP)  problem  is 


.  .  T 

maximize  c  x 

(1) 

subject  to  Ax  <_  b 

(2) 

x  _>  0 

(3) 

x  integer. 

(4) 

where  A  is  an  m  x  n  matrix,  b  is  an  m- vector,  and  c  is  an  n-vector. 

A  difficulty  shared  by  the  many  algorithms  which  have  been  proposed  for 
solving  the  IP  problem  is  that  their  computation  time  varies  greatly  from 
problem  to  problem  of  similar  size  and  structure.  The  purpose  of  this 
paper  Is  to  give  uppai  bounds  and  estimates  on  the  number  of  arithmetic 
operations  needed  by  the  Accelerated  Bound-and-Scan  Algorithm  to  solve  any 
given  problem. 

The  Accelerated  Bound-and-Scan  Algorithm  solves  the  integer  programming 
problem  (1,2, 3, 4)  by  implicit  enumeration  of  all  lattice  points  within  a 
certain  n-simplex  In  Euclidean  n-space.  The  number  of  arithmetic  operations 
required  by  the  algorithm  will  be  given  as  a  function  of  the  number  of 
eligible  partial  solutions  through  each  variable.  Methods  for  obtaining 
upper  bounds  and  estimates  on  the  number  of  eligible  partial  solutions,  for 
any  given  pro^em,  will  be  discussed  in  detail.  The  basic  too1-  of  analysis 
used  are  various  results  from  the  theory  of  partitions  of  numbers,  the  Central- 
limit  theorem,  and  geometrical  interpretations  of  the  algorithm.  Many  of  the 
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results  described  here  also  apply  to  the  Bradley-Wahi  algorithm  [3]. 

See  [9]  for  details  on  the  relationship  of  the  Bradley-Wahi  algorithm 
to  the  Accelerated  Bound-and-Scan  Algorithm. 

B.  Analysis  of  Arithmetic  Operations 

A  somewhat  simplified  version  of  the  skeleton  algorithm  will  be 
analyzed  here.  The  "simplified  algorithm"  includes  the  basic  enumeration 
scheme  and  bounds  on  variables  used  in  the  skeleton  algorithm, 
but  it  does  not  include  the  scanning  procedure  or  the  method  for  eliminating 
redundant  nonbinding  constraints.  Inctead,  whenever  a  completion  within  the 
n-simplex  Is  generated,  the  m  nonbinding  constraints  are  checked  in 
sequence  for  feasibility.  If  all  m  nonbinding  constraints  are  satisfied, 
an  improved  solution  has  been  found.  Otherwise,  the  basic  enumeration 
scheme  continues  where  it  left  off  as  soon  as  It  has  been  determined  that 
some  nonbinding  constraint  is  violated  by  the  completion. 

The  simplified  algorithm  is  considered  Instead  of  a  more  sophisticated 
(and  probably  more  efficient)  version  of  the  algorithm  in  order  to  make  the 
analysis  tractable.  The  simplified  algorithm  includes  the  cone  algorithm 
as  a  special  case,  and  the  results  of  the  analysis  for  the  simplified 
algorithm  provide  partial  answers  to  fundamental  questions  which  arise 
regardless  of  the  level  of  sophistication  in  the  design  of  the  algorithm. 

These  questions  Include  (a)  What  is  the  greatest  amount  of  time  the 
algorithm  could  take  to  solve  a  given  problem?  (b)  What  is  the  expected 
computation  time?  (c)  How  should  the  variables  and  nonbinding  constraints 
be  ordered  to  minimize  the  expected  computation  time?  (d)  How  does  the 
computation  time  Increase  as  the  number  of  variables  is  increased?  and 
(e)  How  is  the  computation  time  affected  by  the  quality  of  the  starting 
solution? 
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In  the  following  it  will  be  necessary  to  refer  to  equation  numbers 
in  [9].  Equation  number  q  in  [9]  will  be  designated  by  (9.q), 
whereas  equation  number  q  in  this  chapter  will  be  labeled  (q).  It  should 
also  be  noted  at  this  point  that  only  the  "iterative  portion"  of  the  algorithm 
is  being  considered;  the  relatively  predictable  and  minor  "setup  time"  is 
being  ignored. 

The  basic  idea  of  the  Accelerated  Bound-and-Scan  Algorithm  is  to 
examine  all  completions  which  may  yield  a  larger  objective  function  value  than 
the  current  best  solution.  To  arrive  at  a  completion,  a  sequence  of  partial 
solutions  is  constructed.  The  computational  effort  required  by  the  algorithm 
depends  on  the  number  of  partial  solutions  and  on  the  amount  and  type  of 
computation  required  to  generate  each  partial  solution. 

Partial  solutions  are  generated  on  either  a  "forward  step"  or  a 
"backtrack  step"  in  the  algorithm.  Each  will  be  examined  in  terms  of 
the  computational  effort  it  requires. 

Suppose  (of. —  *pk-l )  is  an  e^9'*b^e  partial  solution,  but  not  a 
completion.  The  forward  step  consists  of  setting  pk  at  t  in  (9.26) 
to  form  the  next  partial  solution.  Consider  the  work  required  to  find  t. 

If  k£ni»  f  =  0  by  (9.30)  and  t  =  0  by  (9.26);  thus,  if  k^n] , 

(p*»’*‘»Pk  r0)  is  automatically  an  eligible  partial  solution.  No  multi¬ 
plications  or  additions  are  required.  If  k>n^,  the  calculation  of  t 
first  requires  (k-1)  multiplications  and  k  additions  to  obtain  f,  and 
then  one  additional  multiplication  and  addition  in  (9.26)  to  obtain  t. 

(Assume  that  prior  to  the  iterative  part  of  the  algorithm  the  1/Bkk, 
k  =  1,---,n,  have  been  calculated  and  stored.)  To  test  whether 
(p*,.*-,p*  pt)  is  an  eligible  partial  solution,  t  must  be  added  to  the 
running  sum  p*  in  (9.24) ,  resulting  in  one  more  addition.  Therefore, 

when  k>n.j,  (k+2)  additions  and  k  multiplications  are  needed  on  the  forward 
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step,  but  If  k<nlt  none  a  re  required.  If  (pf,...,pj*_j)  Is  a  completion 
(k-1  a  n),  the  nonbinding  constraints  must  be  checked  for  feasibility, 
requiring  at  most  mn  multiplications  and  additions,  where  m  Is  the 
number  of  rows  of  A  in  (2). 

It  Is  now  possible  to  give  the  following  lemma. 

Lemma  1  Let  Ap  be  the  number  of  additions  and  Mp  the  number  of  multi¬ 
plications  done  during  the  forward  steps  of  the  simplified  Accelerated 
Bound-and-Scan  Algorithm.  If  Ej  is  the  number  of  eligible  partial 
solutions  through  variable  j, 

aF  S.  Id-n,  (Jt3)Ej  *  mnEn  * 
and 

Mp  <15;^  ♦  mnEn  . 

Proof  The  proof  has  largely  been  given  above.  Every  time  one  of  the  Ej 
eligible  partial  solutions  (p|, •  •  •  ,pj) ,  n^j<n,  is  generated,  (j+3) 
additions  and  (j+1)  multiplications  are  required.  If  j  -  n,  at  most 
mn  of  each  are  needed. 

The  "backtrack  steps"  of  the  algorithm  will  now  be  analyzed.  Suppose 
again  that  (p*>" * »p£_i )  *s  an  eligible  partial  solution  and  that  pk 
Is  set  at  t  during  the  forward  step  of  the  algorithm.  If  (pf,- • • ,p£_-j ,t) 
is  an  eligible  partial  solution,  the  algorithm  proceeds  with  an  additional 
forward  step.  If  It  Is  not  an  eligible  partial  solution,  the  algorithm 
attempts  to  construct  a  new  eligible  partial  solution  up  to  variable  k-2 
by  resetting  pk_2  at  pk-2+1/Bk-2  k-2*  This  °Pera^on  Initiates  the 
"backtrack  step"  and  requires  a  single  addition.  (Recall  that  the 

1/B^  are  stored,  1  =  n.)  To  check  whether  (pf,- • • ,pk_2  p^) 
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an  eligible  partial  solution,  l/B^  k-2+(‘pk-l^  mus*  be  adc,ect  t0 
k  1 

T*_.jo*.  That  requires  two  more  additions,  or  three  In  all  during  a 
backtrack  step.  If  the  partial  solution  is  not  eligible,  another 
backtrack  step  to  Is  made,  requiring  another  three  additions- 

If  It  Is  eligible,  a  forward  step  Is  then  made.  There  Is  one  exception 
to  this  description.  Once  a  completion  (p|,- • • ,p*)  has  been  found 
and  tested  against  the  non-binding  constraints,  the  algorithm  "backtracks" 
to  on  by  resetting  cn  at  PjIJ+VBnn.  Since  adjusting  2.^  p*  requires 
only  one  addition,  backtracking  to  pn  requires  only  two  additions 

Lemma  2  Let  Ag  be  the  number  of  additions  and  Mg  the  number  of  multi¬ 
plications  done  on  the  backtrack  steps  of  the  Accelerated  Bound-and-Scan 
Algorithm.  Then 

Ar  <  3  yn"]  E  •  +  2E 
and 

mb  =  0. 

Proof  The  algorithm  can  backtrack  to  variable  j,  i.e.,  reset  p.  at 

J 

p*+l/B..,  it  and  only  if  an  eligible  partial  solution  (pt,..-,p$)  has 
J  J  J  J 

previously  been  constructed.  Therefore  the  number  of  times  the  algorithm 
backtracks  to  variable  j  is  at  most  E-,  and  three  additions  are  needed 

J 

for  each  such  occasion 

The  following  fundamental  theorem  follows  immediately  from  Lemmas 
1  and  2. 
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Theorem  1  If  Aj  Is  the  number  of  additions  and  the  number  of  multi¬ 
plications  required  during  the  Iterative  part  of  the  simplified  Accelerated 
Bound-and-Scan  Algorithm,  then 

^  <  i£^J+3  V  +  3  Ejt2E-  •  <5) 

and 

«T  i  iT-i,  u+1)ej  *  "E»-  f6) 

The  only  arithmetic  operations  done  during  the  Iterative  part  of 

the  algorithm  are  additions  and  multiplications.  No  divisions  are  necessary, 

and  subtractions  have  been  assumed  to  be  equivalent  to  additions  In 

computation  time.  Comparison  and  assignment  operations  have  been  Ignored, 

but  they  could  easily  have  been  counted.  The  Importance  of  Theorem  l  Is 

that  if  the  time  to  do  an  addition  and  the  time  for  a  multiplication  are 

known,  and  If  upper  bounds  (or  estimates)  on  the  Ej  are  known, It  Is  possible 

to  give  an  upper  bound  (or  an  estimate)  on  the  time  required  by  the 

Accelerated  Bound-and-Scan  Algorithm  to  solve  any  particular  case  of  problem 

(1,2, 3, 4).  Upper  bounds  on  the  E.  will  now  be  developed. 

J 


Some  Upper  Bounds 


Lemma  3  The  number  of  eligible  partial  solutions  tnrough  variable  oj, 
defined  as  the  number  of  solutions  to  (9.21),  Is  bounded  above  by  the 


number  of  distinct  solutions  to  the  system 
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Proof  The  lenma  will  be  proved  by  defining  '  one-to-one  mapping  from  the 
set  of  solutions  to  (9.21)  Into  the  set  of  solutions  to  (7).  Consider 
any  solution  (pf,***,pj)  to  (9.21).  By  (9.27)  each  pf  Is  of  the  form 

pf  ■  t£  +  yf/B^  1  ■  1  »•  •  •  ,j» 


where  y^  Is  a  non-negative  Integer,  and  0<t|<1/B^.  The  solution 
(p^»,,,.Pj)  also  satsifles 


and 


0  1  p*  1  p-j 


1  =  1  .*  •  •  ,j 


Il=l  o*  1  K 


Corresponding  to  every  solution  (pjV.Pj)  to  (9.21)  is  a  solution 
(p , , • *  •  ,p  . )  to  (7)  obtained  by  letting 

*  J 

Pi  =  p|  -  t*  »  y|/B11  1  ■  l,***J. 

To  see  that  (p  1 » *  •  *  ,p j )  Is  feasible  for  (7),  notice  that  =  yf, 

an  Integer;  p^O  since  y£>0  and  B^>0;  since  p ^  and 

M*l°i-  ' 

It  still  remains  to  be  proved  that  the  mapping  is  one-to-one. 
Suppose  it  is  not.  Then  two  different  solutions  p*  =  (pf,...,pj)  and 
p**  =  (p**,* •* ,p**)  to  (9.21)  must  correspond  to  a  single  solution  to 
(7).  Let  k  denote  tne  first  Index  for  which  pf  t  pf*.  Recall  that 

pk  *  tk+yk/Bkk  and  pk*  =  t**+y**/Bkk.  If  *  p£*.  then  either 

t*  f  tf*  or  yi  f  yf*.  But  y*  must  equal  yj**»  for  otherwise  p*  and 

k  K  K  K  K  K 

p**  map  into  different  solutions  to  (7).  And  t£  must  equal  t** 
because  t£  and  t£*  are  functions  only  of  the  first  (k-1)  components 

of  p*  and  p**  respectively.  Therefore,  there  are  at  least  as  many 

solutions  to  (7)  as  there  are  to  (9.21),  as  was  to  be  shown. 
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Lemma  4  The  number  of  solutions  to  (7)  Is  equal  to  the  number  of  Integer 
solutions  to  the  Inequality 


^1=1  y1/B1i  -  1 


(8) 


0  I  y<  *  3  l****, J, 


where  y.|  ■  for  1  *!,•••, j. 

Proof  The  condition  =  0  (mod  1)  simply  says  that  B^p^  must  be 

in  Integer,  say  yi .  Then  =  y^/8^  substituted  into  the  requirements 
O-PiiPi  0  r  1 .  *  *  *  •  J  >  and  ^^p^l  results  in  (8) 


l*f  the  are  rational,  it  Is  po-sible  to  calculate  precisely 

the  number  of  solutions  to  (8)  by  solving  a  related  problem  in  the  theory 
of  partitions  of  numbers.  The  theory  of  partitions  [11]  deals  with  the 
problem  of  counting  the  number  of  nonnegative  integer  solutions  to  equations 
of  the  form 


z,1 


a<y.  =  a. 


1  r  i 


where  a 


1’ 


•••,ar  and  a  are  known  positive  integers  The  problem  may  be 


posed  as  that  of  counting  the  number  of  ways  the  integer  a  may  be  divided 
into  parts  of  sizes  a^,*,*,ar.  If  only  y^  parts  of  size  a^  are  available, 
the  problem  becomes  one  of  finding  the  number  of  Integer  solutions  to  the 
bounded  variable  Oiophantine  equation 


2i-i  Vi  =  d 


0  <  <  *i 


(9) 


i  =  1 . . ,r. 


8 


Asrume  the  8^  in  (8)  are  rational.  A  sufficient;condition  for  this 
to  be  true  is  that  the  coefficients  of  the  original  IP  problem  be  rational.  ' 
Recall  that  the  8-  are  also  positive.  It  is  possible  therefore  to  multiply 
both  sides  of  (8)  by  a  positive  integer  and  obtain  a  new  inequality  whose 
coefficients  are  positive  integers.  The  addition  of  an  Integer  valued  slack 
variable  to  this  inequality  results  in  an  equation  of  type  (9). 

,  i 

One  way  of  counting  the  number  of  integer  solutions  has  been  developed 
previously  by  the  author  [7],  and  Is  restated  here  as  Theorem  2.  The  notation 
,!k|s"  means  "the  integer  k  divides  the  integer  s". 

l 

Tneorem  2  Let  F(a)  denote  the  number  o^  integer  solutions  to  (7)  and 
Pi  -  +  1  =  1  »•  ”  »r- 

Qs  *  £i  =  l  ‘  ^i=l  pi  s  = 

i?ai|s  ;  i  |  s 

Then  F (0 )  =  1  and  \ 

V  F(s)  -  (1/s)  Q4F(s-a)  s  =  1  ,•  ••  ,a.  (10) 

Proof  See  [7]. 

Although  Theorem  2  can  be  used  to  calculate  upper  bounds  on  computational 

\  I 

effort  in  the  Accelerated  8ound-and-Scan  Algorithm,  it  is  likely  to  be  very 
expensive  because  the  calculation  of  r(a)  by  (10)  requires 
l+2+---+a  =  ^  multiplications  and  additions.  Theorem  3  is  another 

procedure  (first  presented  in  [8])  for  calculating  F(a)  which  requires 
elementary  ailthmetic  operations  proportional  to  a. 
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Proof  See  [8] 

Algorithms  based  on  Theorem  2  or  Theorem  3  may  be  used  to  calculate 
the  number  of  integer  solutions  to  equation  (9).  It  would  be  very  useful, 
however,  to  approximate  this  number  by  an  explicit  function  of  a^,**,,ar,a, 
and  r.  Such  an  explicit  function  would  provide  information  on  the  rate 
of  growth  of  the  number  of  eligible  partial  solutions  up  to  variable  r  as 
r  and  the  coefficients  vary. 
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E.  Cesaro  [5]  stated,  without  proof,  that  the  number  of  positive 
Integer  solutions  to  the  equation 


ii-i  aiy>  =  a 


(22) 


is  approximately  equal  to 


r-1 


a  /( (r-1 ) !  n1L1  ai). 


(23) 


Lemmas  5  and  6  will  put  Cesaro's  conjecture  into  a  precise  form.  Theorem  4 
will  apply  the  results  of  the  lemmas  to  the  inequality 


v  k 


Ii=l  ^i/Bii  ^  1 

yi  >.  o 


(24; 


i  ~  1 »  *  k , 


which  is  the  same  as  (8)  without  the  upper  bound  restrictions  y^i^ 

(i  =  1  *  *  *  * ,  k) .  The  number  of  nonnegative  integer  solutions  to  (24)  is  an 
upper  bound  on  the  number  of  eligible  partial  solutions  through  variable 
k  for  both  the  IP  problem  and  the  cone  problem. 

The  form  of  (22)  which  is  most  useful  for  the  analysis  here  is  the 
case  in  which  one  of  the  variables  y^ ,  say  y^ ,  represents  an  integer 
slack  variable.  Assume  then  that  a,  -  1  and  the  a.  (j  =  2,---,r)  are 

*  J 

otherwise  arbitrary  strictly  positive  integers. 

Lemma  5  Let  a1,***,ar  and  a  be  strictly  positive  integers.  If  a^  =  1, 
the  number  of  integer  solutions  (y1,--  ,yr)  to  equation  (22),  all  of  whose 
components  y-  are  strictly  positive,  is  bounded  above  by  (23). 

w 

Proof  For  s  =  l,-*,r  and  all  integer  i,  let  F£(i)  denote  the  number 
of  strictly  positive  integer  solutions  to  the  equation 
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s.  Consider  first  the 
for  all  strictly  positive 
Notice  that  for  k>2, 


(25) 


V-i  Vo  ■ 1  ■ 

The  proof  of  the  lemma  will  be  by  Induction  on 
case  s  =  1.  Since  a-j  *  1,  F^(1)  *  l/a1  =  1 
1.  Now  assume  the  lemma  Is  true  for  all  s<k. 

,  s  _C 1 / 

Fk(t)  *  l  j.i  Ff-l 

Since  F*  .j(h)  Is  nondecreasing  in  h, 

F£.-|(i-jak)  £  0/ak)  ^  F*_,  (1-jak+P). 


(26) 


(27) 


Therefore, 

[1/aJ  a  -1 

FJOlil  j.,k  0/.k)  I„k0  Ft.,  (1-0 vp) 

*  (1/ak'  ^l=1-[1/ak]ak  Fk-1(t) 

i  0/ak)  1\Iq  Fk-i^)  since  Fk_i(*)i0 

i  O/a^)  ^.q  £k  ^/( (k-2) !  nk~]  a^)  by  the  Induction  hypothesis 
-(1/ak}  l\lo  1  ftk_2/((k-2)!  nk:|  a.))  dt 

*  (1/ak}  jQ  ftk'2/((k-2)!  n kr\  aj)}  dt 

»  1  k~ V( (k- 1 ) !  a.)  , 


as  was  to  be  shown. 

Lemma  5  stated  that  the  number  (23)  is  an  upper  bound  on  the  number  of 
strictly  positive  Integer  solutions  to  (22).  Using  very  similar  arguments, 
Lemma  6  below  states  that  (23)  is  a  lower  bound  on  the  number  of  nonnegative 
Integer  solutions  to  (22). 
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Lenina  6  Let  a,,-**,ar  be  strictly  positive  Integers.  If  a,  =  1, 
the  number  of  nonnegative  Integer  solutions  to  equation  (22)  Is  bounded 
below  by  (23). 

Proof  For  s  =  !,•••, r  and  for  all  integer  1,  let  F$(i)  denote  the 

number  of  nonnegative  integer  solutions  to  (25).  Of  course,  If  1 <0 , 

F$(i)  =  0.  Since  a1  =  1,  Fg(i)  is  a  nondecreasing  function  of  i,  and 

F,(1)  =  (1/a-,)  =  1  for  all  nonnegative  Integer  i.  To  complete  the  induction 

proof,  assume  the  lemma  Is  true  for  all  s<k.  For  k>_2, 

[i/ak]  .  .  4 
Fk(l^  =  l  j-0  Fk-l(l~jak^ 

[i/ak]  ak*l 

iZj-0  (1/V  2p-0  Fk-l(i'JVp) 

=  0/ak)  IJJ.li-[i/ak3ak-ak+1  Fk-lU) 

=  (l/aR)  Fk_1(i)  since  F^U)  =0  if  t  <  0. 

0/ak)  ^k"2/((k"2)!  njl]  aj)  the  induction  hypothesis 

-0/h)  It  1,  ,k-z/((k-2)!  a.) 

i<vy  z,l.  1  <tk-2/u*-2)!n!s:! 

X,"  I 

=  (l/ak)  J%tk_2/((k-2)!  nk~]  ajjjdt 
=  ik-1/((k-l)!  n  aj), 

as  to  be  shewn  . 

Theorem  4  Let  Ek  be  the  number  of  nonnegative  integer  solutions  to  (24)- 
Then 

Ef*  .  <28, 
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where 


ei :  -  ["1S1  Biiik/(k|  "jki  <niki 

1« 


(29) 


ana 


Ek*  =  (l+[ni^1  n1^1  Bii])k/(k!  n^Cn^  B^]).  (30) 

If)  ifj 

Proof  Since  B^>0  for  all  i  a  1,***,k,  (24)  is  equivalent  to 


2j=1  (ni=l  B1i)yj  -  ni=1  Bi 1 


(31) 


if) 


yj  i  0 


j  =  1 , • • • »k. 


The  number  of  solutions  to  (31)  Is  greater  than  or  equal  to  the  number  of 
solutions  to 


+  Vi 


j  *'!,••• ,k+l . 


(32) 


Applying  Lemma  6  to  (32)  results  in  (29).  To  prove  (30),  consider  the 
transformation  of  variables  £ .  =  y.+  l;  £  .  is  a  positive  integer  If  and 

J  J  J 

only  if  y.  Is  a  nonnegative  integer,  and  (31)  Is  equivalent  to 

J 

£j  =  l  (“n1=l  B1i^j  -n1=l  Bii  +  Ej=l  ^n1=l  B1i  ^  *33) 

ifj  ifj 

>  0  j  =  1 ,* * • ,k. 

The  number  of  solutions  to  (33)  is  bounded  above  by  the  number  of  solutions  to 

£j=l  £n1=l  Bi1^j  +  £k+l  *  1  *  ^n1  =  l  Bii  +  £j=l  nj=l  B11^  ^34^ 

1 1 J  i 

£j  >  0  j  *  l,*"  ,k+l . 

J 
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Applying  Lemma  5  to  (34)  results  In  (30),  as  was  to  be  shown.  Results  similar 
to  those  of  Theorem  4  may  also  be  found  in  Padberg  [16]. 

Notice  that  ££  Is  approximately  equal  to 

n^B^/k!,  (35) 

and  E£*  is  approximately  equal  to 

(1/k!)  {l+ni^1B1i+[^1  ni^BiiHl+(l/ni^B1i)  +  Ij^d/Bjj))^1  .  06) 

i*j 

The  expression  (35)  has  an  interesting  geometrical  Intrepretation. 

If  the  yi (i  =  1  *  *  *  * ,k)  are  considered  as  continuous  variables,  the  region 
defined  by  (24)  is  a  k-simplex  with  vertices  (0,***,0),  (B^  ,0,*  •  •  ,0) , 

(0 ,®22*0, ’  “  »0) , ' *  * ,(0 ,*  *  * ,0 ,Bnn) .  By  [10]  Its  volume  Is  precisely  (35). 

That  is,  the  estimate  (35)  of  the  number  of  lattice  points  within  the 
region  (24)  is  simply  the  volume  of  the  region. 

The  Accelerated  Bound-and-Scan  Algorithm  examines  lattice  points 
within  an  n-simplex.  In  the  process  of  constructing  the  completions 
within  the  n-simplex,  lattice  point?  within  lower  dimensional  projected 
k-slmplices  (partial  solutions)  are  also  examined.  According  to  Theorem  1, 
the  computational  effort  in  the  algorithm  depends  on  the  number  of 
eligible  partial  solutions  through  each  variable,  that  is,  the  numbe”  of 
lattice  points  within  each  projected  k-simplex.  One  very  crude  way  of 
estimating  the  computation  time  would  be  to  use  (35)  or  (36)  as  an  estimate 
of  E^,  the  number  of  eligible  partial  solutions  through  variable  k. 

This  raises  a  very  natural  question:  Is  there  an  optimal  ordering 
of  the  variables  which  minimizes  the  estimated  computation  time?  A  change 
in  the  ordering  of  the  variable  corresponds  to  a  change  in  the  ordering  of 
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the  binding  constraints  (9.8).  Each  of  the  n!  orderings  of  these  constraints 
corresponds  to  a  different  Inequality  system  (9.14).  However,  for  a  given 
system  (9.14),  the  first  n^  variables  can  be  reordered  without  disturbing 
the  lower  triangular  property  of  (9.14)  and  (9.18).  If  either  (35)  or  (36) 

Is  taken  as  the  estimate  of  the  number  of  eligible  partial  solutions  through 
variable  k,  the  first  n^  variables  should  be  ordered  in  Increasing 
order  of  the  B^.  This  Is  equivalent  to  ordering  the  first  n^  variables 
In  Increasing  order  of  their  ranges  within  the  n-simplex.  Such  an  ordering 
is  in  agreement  with  the  computational  results  reported  by  Cabot  [4]  on 
the  knapsack  problem. 

Another  question  which  can  be  answered  to  some  extent  by  the  use  of 
volume  as  an  approximation  to  the  number  of  eligible  partial  solutions  Is: 

How  does  the  quality  of  the  starting  solution  affect  the  computational 
effort  of  the  algorithm? 

Denote  by  the  volume  of  the  region  defined  by  (24);  is  given 
by  (35).  If  an  Improved  starting  solution  is  known,  the  region  corresponding 
to  (24)  is  given  by 

Ii=i  VBii  ^ 01 

y1  >  0  i  -  1  ,*  *  *  ,k 

for  some  a<l.  The  volume  of  this  region  is  equal  to  V.  ,  where 

Is  f  CL 

V,  ■  ‘"tii  «Bii>/kl  =  «kv 

Therefore,  the  estimate  of  the  number  of  eligible  partial  solutions  through 

1/ 

variable  k  is  reduced  by  a  factor  of  a  .  This  can  result  In  a  substantial 
reduction  In  computational  effort,  particularly  for  large  k.  That  the 
reduction  In  computational  effort  can  be  so  great  is  In  general  agreement  with 
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the  common  observation  that  the  efficiency  of  implicit  enumeration  algorithms 
Is  highly  dependent  on  the  quality  of  the  starting  solution. 

The  volume  of  a  k-slmplex  may  not  be  a  good  estimate  of  the  number  of 
lattice  points  within  It.  The  extent  to  which  this  estimate  can  differ 
from  the  actual  number  is  discussed  next. 

D.  Volume  and  the  Number  of  Lattice  Points  Within  an  n-SImplex 

The  relationship  between  the  volume  of  a  region  and  the  number  of  lattice 
points  within  the  region  has  for  a  long  time  been  of  Interest  In  number 
theory.  The  Minkowski  geometry  of  numbers  [12]  for  example,  specifies  the 
minimum  volume  that  an  arbitrary  convex  body  symmetric  about  the  origin 
must  have  to  guarantee  the  existence  of  a  lattice  point  other  than  the  origin 
within  the  body.  Another  example  of  interest  Is  the  following  theorem 
proved  by  G.  Pick  in  1899. 

Theorem  5  Let  S  be  a  simplex  In  E  (a  triangle)  with  Integer  vertices 
and  area  V(S).  If  b  Is  the  number  of  lattice  points  on  the  boundary  of 
S  and  c  Is  the  number  Inside,  then 

V(S)  =  b/2  +  c  -  1.  (37) 

See  Coxeter  [6]  for  a  discussion  of  this  theorem. 

The  following  example  shows  that  Theorem  5  cannot  be  generalized 

k  k 

directly  to  slmpllces  in  E  .  For  k>3  the  k-simplex  In  E  whose  k+1 
integer  vertices  are  (0,0, •••,0),  (1,0, •••,0),  (0,1 ,0,* • • ,0) ,• • • , 

(0,0,* ' •  ,1 ,0)  and  (1,1  ,**•  ,1  ,j)  has  volume  j/k!,  but  the  only 
lattice  points  within  the  simplex  are  the  k+1  vertices.  So  for  fixed 
k  the  volume  may  be  any  positive  integer  multiple  of  1/k!,  but 

c  =  0  and  b  =  k+1,  values  Independent  of  j. 
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Under  the  assumptions  of  Theorem  5,  (b+c),  the  total  number  of 

lattice  points  In  triangle  S,  must  satisfy 


(b+c)  <  2V(S)  +  2 

(38) 

(b+c)  i  V( S)  +  1  . 

(39) 

The  above  example  shows  that  (39)  cannot  be  generalized  directly.  However, 

L 

relationship  (38)  has  an  analog  In  Euclidean  k-space  E  : 


1/ 

Theorem  6  If  S  is  a  k-simplex  in  E  with  Integer  vertices  and  volume 

V(S),  the  number  of  lattice  points  within  S  Is  at  most  k!V(S)+k. 

Proof  Let  x^,x^,**-,x^  be  the  vertices  of  S.  Every  point  x  In 
S  can  be  expressed  as  convex  combination  of  the  vertices  of  S: 


x 


,(0) 


ii! 


i  “i 


r  k 

-1=1 


<  i 


p.j  0  1  =  1 » *  ’  ,k. 


The  only  points  x  in  S  of  Interest  are  those  which  satisfy  the  linear 
congruences  x^  0  (mod  1).  Since  x^  is  an  integer  vertex,  x  s  0  (mod  1) 
If  and  only  If  x-x^  r  0  (mod  1).  Therefore  the  number  of  lattice  points 
x  in  S  is  the  number  of  distinct,  but  not  necessarily  integer, 

(p-j  ,*  ■  •  ,pk)  which  satisfy 

»1<*(,)-x(0))  =  0  0"Od  1).  (4o) 

r  k  x 

It-1  °i  -  1 

oi  i  0  i  =  1  ,•  •  •  ,k. 
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Notice  that  the  above  congruence  system  In  variables  p^»’"iP(c  has  a 
non-singular  coefficient  matrix  of  Integers.  The  solution  set  of  this 
system  Is  preserved  by  the  following  elementary  row  operations: 

(a)  multiplication  of  a  row  by  -1, 

(b)  Interchange  of  two  rows, 

(c)  addition  of  an  Integer  multiple  of  one  row  to  another  row. 

Using  only  the  row  operations  specified  above  It  Is  possible  to  transform 
the  congruence  system  Into  one  In  which  the  coefficient  matrix  Is  in  Hermlte 
normal  form  [1]: 


L  0  1  a  1 ,*  * •  ,k. 


where 


B.. j  Is  an  Integer  j  ■  l,***,k;  1  ■ 
Bjj  >  0  j  =  1 ,• • • ,ki 


0  i  B*j  *  Bjj 


,k;  1 


We  now  show  that  the  system  (41)  can  be  satisfied  by  at  most 


(B11B22*  *  *Bkk)  +  k 

distinct  values  of  <p ^ • »Pk) •  If  any  p j  =  1 ,  j  *  lt***,k,  then  all 
other  p^,  1  f  j,  must  take  the  value  zero.  The  k  ways  in  which  this  can 


19 


happen  (some  pj  •  1 ,  j  ■  1 ,* • • ,k)  determine  the  k  lattice  points 
Now  consider  the  number  of  ways  system  (41)  can  be 
satisfied  with  the  additional  requirement  that  pj<l  for  all 
j  =  1 , • * ♦  ,k .  To  satisfy  the  congruence  system  p^  must  be  chosen  so 
that 


B11p1  =0  (mod  1). 


Since  we  have  counted  Pl  =  1  already*  p*  can  take  on  at  most  the 
l  8  i-l 

B-j  1  values  .  Now  suppose  that  p1  ,  •  •  *  .ps_i  have 


been  set  at  feasible  values 


V 


>p 


s-1* 


Then  p$  must  be  chosen 
■s-1 


so  that  If  f  is  defined  to  be  the  fractional  part  of  B$jP* 


Bssps  5  "f  ^mod 

f  *  0 


Let 


t  «■ 


0  <  f  <  1. 
J$s 


Then,  excluding  the  case  P_  e  1  which  has  already  been  counted,  P 

1  Bss-1 

can  take  on  at  most  the  B  values  t,t+n — —  *  Therefore, 

5  ss  ss 

there  are  at  most  (B^—B^)  ways  in  which  the  system  (41)  can  be 
satisfied  by  distinct  (p|,‘ • •  ,pk)  for  which  no  p j  =  1 ,  j  *  1 , -  • • ,k. 
Since  there  are  k  ways  In  which  one  can  choose  some  Pj  *  1, 
j  =  1 , •  •  •  ,k,  there  are  (B^ ' '  *Bkk)+k  ways  t0  So1ve  and  henCe 
(40). 

The  relationship  of  the  upper  bound  to  the  volume  of  the  k-simplex 
Is  very  Interesting.  The  volume  V(S)  of  an  k-simplex  S  with  vertices 
*<°>.-.x<«  is  given  by  [10]: 
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V(S) 


1 

FT 


(Tx}'>-x<°>)  .  .  •  <*<k>-x<°>?i 


det 


\<4’1:40)> 


«  •  % 


«0,», 


where  |Zj  denotes  the  absolute  value  of  Z.  The  matrix  whose  determinant 
is  taken  to  compute  V(S)  is  just  the  coefficient  matrix  of  the  congruence 
system  (40).  The  absolute  value  of  the  determinant  is  not  changed  by 
the  row  operations  in  (a),  (b),  (c).  Since  Bjj>0,  j  =  1,-*-,k, 


B„  •  •  •  Bkk  =  k!  V(S). 

We  may  conclude  that  if  S  is  an  k-simplex  with  integer  vertices  and  volume 
V(S),  the  number  of  lattice  points  within  S  is  at  most 


klV(S)  +  k. 


This  upper  bound  is  sharp,  as  illustrated  by  the  following  example. 

The  simplex  with  vertices  O.e^  ,•  •  •  .e^,  where  ej  is  the  jth  unit  coordinate 

vector,  is  called  the  standard  k-simplex.  The  only  lattice  points  in  this 

k-simplex  are  the  k+1  vertices.  Let  us  verify  that  this  agrees  with  the 

upper  bound  (Bi i " ’Bkk)+k-  Letting  x^  =  0,  x^  -  e^ ,  1  =  1 , *  *  - , k, 

the  congruence  system  is  already  In  Hermite  normal  form  with  B .  -  =  1 , 

J  J 

j  =  k,  so  (B] i ' * "Bkk)+k  5  k+l- 


E .  Estimating  the  Number  of  Eligible  Partial  Solutions 

In  the  previous  section  it  was  shown  that  the  volume  of  a  k-simplex  with 
Integer  vertices  may  differ  from  he  number  of  lattice  points  within  it  by 
as  much  as  a  factor  of  k!  In  spite  of  this  possible  shortcoming,  the  volume 
remains  a  useful,  though  rather  crude,  tool  for  specifying  the  order  in  which 
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the  variables  should  be  placed  and  for  demonstrating  the  importance  of 
finding  a  good  starting  solution. 

In  this  section  a  somewhat  more  sophisticated  technique  is  used  to 
approximate  the  number  of  eligible  partial  solutions  through  each  variable 
j.  It  Is  based  on  the  observation  that  the  number  of  solutions  to  (7) 
is  equal  to  tne  number  of  eligible  partial  solutions  through  variable  j 
if  j^,  but  if  j>n^,  the  number  of  solutions  to  (7)  is  an  upper 
bound  which  may  be  significantly  nigner.  Tneorem  3  is  appropriate  for 
j<n, ,  but  for  j>n^  another  approach  would  be  useful. 

The  approacn  developed  in  this  section  is  to  compare  the  basic 
enumeration  scheme  of  the  algorithm  to  a  stochastic  process  in  which  the 
extreme  point  weights  are  random  variables.  The  design  of  the  stochastic 
model  will  require  certain  subjective  judgments  about  the  behavior  of  the 
algori thm. 

To  simplify  the  analysis,  assume  that  p.  =  1  for  all  j  -  l,-**,n. 

J 

This  assumption  is  required  only  for  the  approximation  of  Ej  for  j>n^. 
For  j^n,,  Theorem  3  (which  allows  p  .  1 )  maybe  used  to  calculate 

If  a  total  enumeration  scheme  involving  the  ok  variables  were 
used  to  solve  the  IP  problem,  all  lattice  points  witnin  the  parallelepiped, 


*  I,",  »j(y(i)-y(0)> 


0  .1  1 


1  »•  •  •  ,n, 


(44) 


corresponding  to  (9.16)  would  be  enumerated.  Of  course,  the  algorithm  uo?s 
not  enumerate  all  lattice  points  within  the  parallepiped,  but  it  doe.  consider 
partial  solutions  (p^.'-'.p^)  for  which  Ij=ipjl’-  1°  the  design  of  tne 
stochastic  model,  the  first  subjective  judgment  is  that  the  behavior  n*  t.no 
extreme  point  weights  p^,‘--»p  in  a  total  enumeration  kvk>  s.-.c>  b-v 
approximated  by  n  independent  random  variable'  uni i^rr.  ■,  .)» .  vibyt  .a  D<?t*ee  ■ 


zero  and  bne.  If  the  extreme  point  weights  were  so  distributed,  any 
realization  (p1>**,,pn)  would  correspond  to  a  random  "continuous" 
point  in  the  parallepiped,  rather  than  to  a,  random  lattice  point. 

Recall  that  the  objective  of  this  analysis  is  to  approximate 
the  number  of  eligible  partial  solutions  through  variable  k  for  every 
k  =  n^+l,--*,n.  Let;  k  be  any  integer,  n^<k<_n,  and  suppose 
(pl  *‘  ‘  ‘  ,pk-l)  1s  an  e^19''b^e  partial';  solution  through  variable  k-1 . 
Then  there  exists  an  eligible  partial  solution  through  variable  k  of 
the  form  (p^  »*'"  ’P^-i  1  f  and  only  conditions  (9.23)  and  (9.24) 

hold:  i 


f  +  8k|<pk  =  0  (food  1 ) 


(9.23) 


i 

where  f 


is'  the  fractional  part  of 


dk  + 


yk-l 

Zj  =  l 


Bk  ip  i 


(9.24) 


.  If  the  pi  are  assumed  to  be  random  variables  in  the  model  then  f 

is  also  a  random  variable.  In  the  design  of  the  stochastic  model,  the 
second  subjective  judgment  is  that  for  k>n^  the  fractional  part  f  may 
be  approximated  by  a  random  variable  .  liformly  distributed  between  zero 
and  one,  and  that  f  is  independent  of  the  partial  sum  V.  .  p..  Under  these 

l  J  *  vl 

assumptions,  f  =  0  occurs  with  probability  zero  for  k>np  so  that  the 
number  of  eligible  partial  solutions  through  variable  k,  for  any  Dartial 
solution  (p^ , • • • ,pk_i )„  is  the  largest  integer  such  that 

\ 

,  0-f>/Bkk*  («k-U/Bkk<.1  -  pr 


or 

i 


i 


i 

i 
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“k  =  CBkk(1’^j*l  pj*  +  f3*  \ 

Let  <3pk  denote  the  random  variable  1 

% '  Bkk  c-^1  »J>- 

l 

Lemma  7  Let  f  be  a  random  variable  uniformly  distributed  between  zero  and 
one,  and  suppose  f  Is  Independent  of  the  random  variable  cf. .  If 

wk  =  ft>k+f^’  then 

-  ftfk). 

where  £  denotes  the  expectation  operator.  ; 

»  i 

Proof  Let  £(wk|fk)  denote  the  conditional  expectation  of  qiven 
Then 

i 

€(Wki4k)  =  t°?k]p(v^k3+f<1)  + 

-  +  (Dfk>;i)p(fii-v^k3) 

=  [<?k3  (i-fk+[fk])  +  (Wk>D(<Pk-^k]) 

.s-V  ' 

Therefore , 

f(«k>  ■  g(£ukiv>  =  ewk>, 

as  was  to  be  shown. 
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At  this  point  it  is  appropriate  to  review  the  motivation  for  considering 
the  stochastic  model.  The  purpose  of  the  model  is  to  provide  a  tractable 
means  of  estimating  Ek,  the  number  of  eligible  partial  solutions  through 
Pk.  For  each  eligible  partial  solution  through  variable  (k-1),  there 
will  be  a  certain  number,  wk,  of  values  of  pk  which  yield  an  eligible 
partial  solution  through  variable  k.  In  the  stochastic  model  the 
and  u»k  (for  k>r.^)  are  random  variables  with  the  property  that 

€(EklEk_i  =  t)  »  t£(u.k)  =  *£(<¥k). 

Therefore,  In  the  stochastic  model, 

f(Ek)  •  «Uk.,) 

By  Induction,  for  k>n^ 

*<Ek>  ■  <45) 

where  E  is  a  constant  which  can  be  found  from  Theorem  3. 
nl 

It  Is  still  necessary  to  interpret  and  calculate  the  expression 
^(*Pk)  in  (43).  If  a  total  enumeration  scheme  were  used  to  solve  the 
IP  problem,  all  values  of  pk  given  in  (9.27)  would  be  enumerated. 

However,  an  implicit  enumeration  scheme  is  used  which  considers  only 
partial  solutions  (p^,'-,,Pk)  for  which 

1  1  k  a  1  •  ,n. 

The  following  model  Is  used  to  approximate  the  behavior  of  the  partial 
sums  H.  =  L-iP-i-  Assume  initially  that  the  p.  are  Independent  random 
variables,  uniformly  distributed  between  zero  and  one.  The  uniform 
distribution  is  used  to  approximate  the  distribution  of  values  that  each 
Pj  would  assume  In  a  total  enumeration  scheme.  In  a  total  enumeration 
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scheme  Hk  may  be  approximated  by  the  sum  of  k  independent,  uniformly 
distributed  random  variables.  Each  would  have  mean  5(pj)  a  1/2 
and  variance  v(p j )  =  1/12.  By  the  Central -limit  theorem  [15,  p.  149], 

Hk  would  be  approximately  normally  distributed  with  mean  k/2  and  variance 
k/12.  However,  the  algorithm  allows  only  the  values  for  which 

0<Hk<_l .  Therefore  the  distribution  of  In  this  implicit  enumeration 
scheme  may  be  approximated  by  a  truncated  normal  distribution. 

The  following  lemma  Is  easy  to  verify. 

Lemma  8  Let  H£  be  a  normal  random  variable  with  mean  k/2  and  variance 
k/12,  ano  let  Hk  be  distributed  according  to  the  conditional  distribution 
of  H*,  given  0<HJ<1 .  Then 

£(Hk)  -  k/2  -  vW  (n(qk)  -  n(-/3JT)}/{N(qk)-N(-  /3IT)}.  (46) 

where 

qk  =  /T7  ( 1  -k/2 )/  /R"  , 

and  n(x)  and  N(x)  are  respectively  the  density  function  and  cumulative 
distribution  function  of  a  normal  random  variable  with  mean  zero  and  variance 
one. 

Note  that 

Wk>  ■  w-H.,)).  (47) 

The  suggested  approximation  to  the  number  of  eligible  partial  solutions 
through  ^k  is  given  by  £(Ek)  In  (45).  Combining  (45),  (46),  and  (47), 
the  estimate  $(Ek)  for  k>n^  is 
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£($k)  *  En,nj.n  $(qj.))-l>(-',Jn^)/(|N(qJ.])-N(-/3nrr| 


Let 


Oj  =  MJ-n/hOT!  (n(qj.,)-n(-^T3^|4,Hqj.,)'N(-/!T3rr)j)-  <48> 

Then  the  a,  may  be  calculated  using  tables  of  the  normal  distribution. 

J 

The  values  of  ctj  are  independent  of  the  data  of  the  problem  and  may  be 
stored  in  a  table  in  a  computer  program.  Using  this  table,  the  estimate 


of  Ek  is 


g(Ek>  =  En,  ^V1BJJV 


(49) 


F.  Checking  the  Nonbinding  Constraints 

Once  a  completion  within  the  n-simplex  has  been  generated  by  the 
simplified  version  of  the  Accelerate  :  Bound-and-Scan  Algorithm,  the  m 
nonbinding  constraints  are  checked  for  feasibility.  This  process  requires, 
as  Theorem  1  notes,  at  most  mn  additions  and  multiplications  for  each 
completion.  However,  if  the  completion  violates  one  of  these  constraints 
the  computation  needed  may  be  significantly  less  because  control  returns 
to  the  basic  enumeration  scheme  as  soon  as  the  Infeasibility  has  been 
discovered. 

The  m  nonbinding  constraints  are  checked  in  some  particular  sequence. 
If  Is  defined  to  be  the  probability  that  a  completion  satisfies  the 
ith  nonbinding  cons-  -int,  the  expected  number  of  multiplications  and 
additions  needed  to  check  the  nonbinding  constraints  in  the  course  of  the 
algorithm  Is  given  by 
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(50) 


where  £(En)  represents  the  expected  number  of  completions. 

If  the  P1  (1  ■  are  know,  the  nonbinding  constraints 

should  be  ordered  so  that 

P,  <  P?  <  *••  <  Pm  (51) 

1  —  i  —  —  m 

to  minimize  (50).  The  ordering  (51)  simply  says  that  the  constraints  most 
likely  to  be  violated  by  a  completion  should  be  checked  first.  However, 
the  Pj  (i  =  1  ,*  *  •  ,m)  are  not  known,  so  it  becomes  necessary  to  estimate 
them. 

One  estimate  o'f  Pi  would  be 

P1  *  V(Rt)/V(S)  , 

where  V(S)  denotes  the  volume  of  the  n-slmplex  S  and  V(R^)  is 
the  volume  of  the  region  R.,  where  R^  =  {xeS:  x  satisfies  the  t th 
nonbinding  constraint}.  The  calculation  of  V($)  by  (42)  is  relatively 
simple,  but  the  calculation  of  V(R.),  though  mathematically  trivial, 
is  somewhat  complicated  by  the  difficulty  of  determining  the  limits  of 
Integration. 

Another  estimate  of  the  P^  could  be  obtained  by  a  simple 
experiment.  Suppose  N  points  (p1,**,,pr))  are  generated  randomly 
within  the  n-slmplex.  Choose  the  estimate 

Pi  a  N1/N  ,  (52) 

where  is  the  number  of  points  satisfying  the  1th  nonbinding  constraint. 
To  generate  a  single  point,  select  each  p^  (1  =  l,’**,n)  according  to  a 
uniform  distribution  on  the  Interval  [0,1].  If  Hn  i  then 
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(pi represents  a  point  within  the  n-simplex.  If  H„>1,  continue 
i  n  n 

by  selecting  additional  (p, , . . . »p_)  until  the  condition  H  <1  Is  satisfied. 

i  n  n— 

The  major  '  back  to  this  experiment  Is  that  for  large  n  the 
probability  that  is  very  small.  It  Is  likely  that  many  random 

points  (on  the  average,  n!)  within  the  paralleplped  (44)  would  have  to  be 
generated  for  every  point  within  the  n-simplex.  Rather  than  perform  the 
experiment  every  time  a  new  integer  programming  problem  is  to  be  solved,  it 
would  be  possible  to  construct  a  table  of  N  random  points  (p^,***,pn) 
for  which  The  values  of  (p.,'**,pn)  in  this  table  are 

Independent  of  the  data  for  any  particular  integer  programming  problem. 

The  table  would  have  to  be  constructed  only  once,  and  it  would  be  used  for 
every  problem  solved  by  the  algorithm. 

Although  the  table  would  have  to  be  constructed  only  once,  the  number 
of  points  (approximately  Nn!)  which  would  have  to  be  generated  for  moderately 
large  n  might  be  prohibitively  large.  For  this  reason  the  following 
modification  to  the  experiment  is  suggested  for  large  n.  Recall  that 
every  point  x  within  ai  n-simplex  S  with  vertices  x^  ,x^  ^  ,•  •  •  ,x^ 
may  be  represented  as 


where 


(0) 


) 


:  n 

-i=lpi 


<  1 


1  iPi  L0  i  =  1 , •  •  •  ,n. 

In  the  experiment  each  Is  selected  according  to  a  [0,1]  uniform 
distribution,  and  if  Hn  =  ^.^p^<_l ,  (p^,’",pn)  represents  a  point 
within  the  n-simplex.  If  it  were  possible  to  generate  the  p^  directly 
so  that  H  < 1 ,  the  major  drawback  to  this  approach  would  be  eliminated. 


Consider  the  following  approximation  to  the  experiment.  It  Is  based  on  the 
observation  that,  for  points  in  the  n-simplex,  Hn  Is  approximately  distributed 
as  a  truncated  normal  distribution. 

Let  H£,  for  k  =  l,***,n,  be  a  normal  random  variable  with  mean 
1/2  and  variance  k/12,  and  let  R^Ct)  be  distributed  according  to 
the  conditional  distribution  of  H£,  given  0<H£<t .  In  the  experiment, 
first  generate  a  value  for  Rn ( 1 ) ,  and  let  pp  =  1-Rn(l).  Next  generate 

a  value  for  Rn_-|0’Pn)»  an<*  Pn_i  =  ^'Rn-l^"pn^*  *n  9enera^  *  the 
k^h  extreme  points  weight  pk  Is  generated  by  letting 

pk  =  (1'Ii=k+lpi)  *  Rk(1'^i=k+lpi)’ 

where  values  for  pk+^,***,Pn  have  already  been  specified. 

The  design  of  the  experiment  Is  explained  In  the  following  way. 

There  are  (n+1)  extreme  points  In  the  n-simplex.  In  order  to  determine  all 
p1  (1  a  0,1 , • • • ,n) ,  It  Is  necessary  to  specify  only  the  weights  p.  on 
n  of  the  extreme  points  since  =  1  •  Note  that  the  Part1al  sum 

J^Iqp^  Is  approximately  distributed  as  Rn(l)  within  the  n-simplex.  Given 

pn,pn-r**',pk+1*  the  Partial  sum 

rk-1 
M=0  pi 

is  approximately  distributed  as  R^, (1  - ^ 2^+1  p -f ) »  so  that  91ven 
Pn,-**,Pk+i»  the  kth  extreme  point  weight  pk  =  ( 1  =k+1  ~Z1  =o°i  ^  is 

approximately  distributed  as  l-£i!]k+iPi_\^"Ii=k+ipi )  •  ^ach 
Pn,Pn  Is  generated.  In  that  order,  thereby  guaranteeing  that 

V1* 

Although  this  approach  of  using  the  truncated  normal  distribution 
eliminates  excessive  computation  which  would  otherwise  be  required,  It  has 
one  outstanding  weakness:  the  use  of  =^+lp 1 ^  as  an  aPProx1mat1on 
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L  1 

for  small  k  to  the  partial  sum  This  difficulty  may  be 

circumvented  by  performing  a  hybrid  experiment.  Let  kQ  be  some 
fixed  positive  Integer  such  that  for  k>_kQ,  the  truncated  normal 
distribution  Is  an  "acceptable"  approximation  to  the  partial  sum 

L  1 

£l=0p1'  Senerate  Pn’**’’°k  “S'* nP  &(<(*)  as  described  above  for 

k  *  n,n-l  • ,kQ.  To  generate  p^,***^  _p  select  each 
(1  *  1  * •  •  •  »k  -1 )  according  to  a  uniform  [0,1]  distribution.  If 
Hk  -l  H  Pj)»  then  (pi  "  »Pn)  represents  a  "random" 

point  within  the  n-simplex.  If  this  condition  on  H.  ,  is  not  satisfied, 

V 

continue  selecting  additional  (p^,‘**,p^  ^  until  it  Is  satisfied. 


G.  An  Example 

The  data  for  the  example  below  is  given  in  the  form  of  (7).  Suppose 
that  all  eligible  partial  solutions  through  variable  p3  are  given  by 
the  solutions  to  the  system 


where 


and 


4P]  h  0 

8pg  =  0 

1/8  +  Pl  +  4p2  +  =  0 


(mod  1 ) 
(mod  1) 
(mod  1), 


P]  +  p2  +  p3  1  ! 

Dl  ;i0  (1  =  1,2,3). 


(53) 


There  are  only  two  solutions  to  (53),  given  by  (pi,p2,p3)  =  (1/4, 
1/8,  1/2)  and  (p^^^)  *  (1/4,  3/8,  1/2).  According  to  Lemma  3,  the 
number  of  solutions  to  (53)  Is  bounded  above  by  the  number  of  solutions 
to  the  system 
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where 


4pl 

a  0 

(mod  1) 

8p£ 

=  o 

(mod  1) 

(54) 

H/< 

=  0 

(mod  1), 

p1  +  p2  ♦  p3 

<_  1 

Pj  i  0 

(1  ■  1,2,3). 

There  are  24  solutions  to  (54),  Indicating  that  Lemma  3  does  not 
necessarily  provide  good  approximation.  However,  the  volume  of  the 
3-slmplex  Is  8/3!  =  4/3,  and  the  approximation  (45)  gives  £(E3)  =  1.88. 

H.  Suninary  of  Estimates  and  Bounds  on  Computational  Effort 

This  chapter  has  examined  In  detail  the  computational  effort  required 
by  a  simplified  version  of  the  Accelerated  Bound-and-Scan  Algorithm.  It  was 
shown  in  Theorem  1  that  the  computational  effort  (additions  and  multiplications) 
may  be  expressed  as  linear  functions  of  the  E^,  the  number  of  eligible 
partial  solutions  through  each  variable  k. 

Corollary  1  If  AT  Is  the  number  of  additions  and  My  the  number  of 
multiplications  required  by  the  Iterative  part  of  the  simplified  algorithm, 

and  AT  i  £l,  <3+3>Ej  ♦  »  E„  +  3£j  Ej  ♦  2En- 

"rilfi,  <3+»Ej  +  ""  V 

Upper  bounds  for  Ay  and  My  are  given  In  Corollary  1.  These  upper  bounds 
are  exact  If  no  Improved  solution  Is  found  and  If  all  m  non-binding 
constraints  must  be  checked  for  every  completion  generated. 

Upper  bounds  on  the  were  developed  next.  Once  upper  bounds  on 

the  Ek  are  known,  upper  bounds  on  the  Ay  and  My  given  in  Corollary  1 
may  be  calculated. 
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Corollary  2  Ek  Is  bounded  above  by  the  number  of  solutions  to  the  Inequal tly 

iii,  vbh  i 1  <«> 

0  iVf  ^  Integer  1  *  l,***,k. 

Methods  for  calculating  the  number  of  solutions  to  (55)  were  given  In  Theorems 
?  and  3.  The  bound  of  Corollary  2  Is  exact  If  k<n^. 

Let  Ek  be  the  number  of  solutions  to  (55)  when  the  upper  bound 
restriction  y^iy^  Is  dropped.  Crude  upper  and  lower  bounds  in  E^  as 
explicit  functions  of  the  were  derived  In  Theorem  4  In  order  to  show 
that  the  nonbaslc  variables  should  be  ordered  according  to  Increasing  B^. 

The  lower  bound  on  E^  was  shown  to  be  the  volume  of  the  k-slmplex  which  Is 
the  projection  of  the  n-slmplex  onto  the  first  k  variables.  The  Importance 
of  having  a  good  starting  solution  was  discussed. 

In  Section  D  It  was  shown  that  the  volume  of  a  k-slmplex  with 
Integer  vertices  may  differ  from  the  number  of  lattice  points  within  It  by 
as  much  as  a  factor  of  k! 

In  Section  E  an  estimate  of  Ek  for  k>n^  was  developed,  and  In 
Section  F  an  experiment  was  designed  to  find  an  estimate  of  the 
probability  that  a  completion  satisfies  the  1th  non-binding  constraint. 

Assuming  that  the  non-binding  constraints  are  ordered  so  that 

pi  •  •  iV 

It  Is  possible  to  estimate  the  computational  effort  In  the  algorithm  as 
follows. 

Corollary  3  Let  £(Ay)  and  £(Wj.)  denote  respectively  the  estimated 
number  ot  additions  and  multiplications  in  the  algorithm.  Then 


£<\>  ■  <v3>e„,  ♦ 

*  S (n ) tz*!?:1, (1")0 -P, Xnjll Pj )  *  niflPj) 

ni 

* 3  Ij.i  Er 


and 


g(Kr>  .  (V')En,  * 

where  E1,,*,,En  are  calculated  using  Theorem  3,  the  are  given  by 
(52),  and  the  <xj  are  given  In  (48). 


Corollary  3  follows  directly  from  Corollary  1  and  equation  (49) 
and  (50). 

The  estimates  of  Corollary  3  are  conservative  in  the  sense  that  they 
assume  no  Improved  solution  is  found  during  the  course  of  the  algorithm. 

Such  an  assumption  may  be  very  realistic,  since  the  Hi liter  heuristic  procedures 
often  find  an  optimal  solution  to  the  problem.  Computational  experience 
reported  by  Hlllier  [13]  Indicates  that  his  better  heuristic  procedures 
obtained  an  optimal  solution  to  the  IP  problem  on  approximately  half  of  his 
test  problems.  When  his  more  powerful  multiple-solution  approaches  were 
used,  an  optimal  solution  was  found  on  about  three  quarters  of  the  problems 
If  such  a  heuristic  procedure  Is  used  to  obtain  a  starting  solution  in  the 
algorithm,  and  If  that  solution  Is  actually  optimal,  the  estimates  of 
Corollary  3  may  be  quite  accurate.  If  an  Improvea  solution  Is  found,  the 
estimates  may  be  somewhat  conservative  . 
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This  chapter  has  presented  bounds  and  estimates  of  the  computational 
effort  required  by  a  simplified  version  of  the  Accelerated  Bound-and-Scan 
Algorithm  to  solve  any  given  problem.  The  simplified  version  of  the 
algorithm  Includes  the  basic  enumeration  scheme  and  bounds  on 
variables  p^  used  In  the  skeleton  algorithm, but  It  does  not  Include 
the  scanning  procedure  or  the  elimination  of  redundant  constraints. 

A  very  natural  question  to  consider  at  this  point  Is  how  the  bounds 
and  estimates  would  change  If  the  more  sophisticated  skeleton  algorithm 
were  analyzed.  In  general  one  would  expect  the  estimates  given  for 
the  simplified  algorithm  to  be  somewhat  conservative  if  the  skeleton 
algorithm  were  used.  However,  It  would  be  possible  for  the  skeleton 
algorithm  to  require  more  computational  effort  on  a  given  problem. 
Fortunately,  it  Is  possible  to  bound  this  additional  computational 
effort,  and  as  a  result  derive  bounds  for  the  skeleton  algorithm. 

Once  the  right-hand  side  of  (9.35)  has  been  calculated  once 
for  each  nonbinding  constraint  at  the  outset  of  the  algorithm,  no 
additional  multiplications  or  additions  are  required  to  check  for 
redundancy  In  the  Iterative  part  of  the  skeleton  algorithm. 

The  scanning  procedure  may  require  more  additions  and  mul ti¬ 
pi  katlons  than  the  corresponding  procedure  for  checking  the  nonbinding 
constraints  In  the  s impllfled  algorithm.  The  scanning  procedure  can 
be  entered  only  once  for  each  of  the  Ep  possible  completions  generated 
by  the  skeleton  algorithm.  In  the  worst  possible  case,  all  m  nonbindir.g 
constraints  would  be  checked  for  feasibility  for  each  completion 
before  the  scanning  procedure  is  entered.  The  most  computation 
which  could  occur  in  the  scanning  procedure  (for  a  given  completion)  would 
result  In  n^n-1)  additions  and  (n(n-l)/2)+l  multiplications 
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In  Step  5  and  three  mil  tip  Hm*  ons  <m«  auditions  m  Steo  7,  or 
n(n-l)+3  additions  and  (n(n-l) '2}*4  multiplications  1t».  ill. 


Corollary  4  If  Aj  Is  the  ruvsber  tf  additions  and  ft,  the 
of  multiplications  required  by  t»«e  Herat ivu  part  of  tne  u*.ei*ton 
version  of  the  Accelerated  tfound-e  >(SSc«r-  Alporlth*. 


.  rn-1 

\  -  Ej-n 


1 


( i+2)tj  ♦  .li-j  l<  *  £n , 


and 


i  Zj«J  (o  +  1)tj  ■»  lwi*-n(r-J)/2*4/Er, 

where  the  Ej  (or  upper  bounds  t';e  [  l  a .•  bo  calculated  from 

Theorem  2  or  Theorem  3. 


The  proof  of  Com!  1  ary  4  follows  from  Coro"') ary  1. 
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